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@ image processing apparatus suitable for multistage compression. 

(57) Disclosed are an image processing method 
and an image processing apparatus capable of 
controlling tfie quantity of coded data to a 
target data quantity. Quantized coefHcients are 
coded by a Huffman coder 14, and the coded 
data and the code lengths are stored in a buffer 
memory 15. The code lengths are also supplied 
to a code length accumulator 17. and the ac- 
cumulation result is compared with values of a 
threshold value table 19 by a comparator 18. On 
the basis of the index (comparison result) from 
the comparator 18, a reference value from a 
reference value calculator 16, and the code 
length accumulate value from the buffer mem- 
ory 15. a stage determining unit 20 determines a 
stage to which the coded data and the code 
lengths in the buffer memory 15 are allocated, 
and outputs the stage as a stage number. 
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BACKGROUND OF THE INVENTION 

The present invention relates to an image processing method and an image processing apparatus for cod- 
ing frequency components of images in units of blocks and outputting the coded data divisionally in a plurality 
5 of stages. 

Recently, with the advent of color output equipment, color DTP in which a computer processes graphics, 
characters. Images, and the like to form a single image has been developed rapidly. 

Since the quantity of data is enormous In processing color images formed by the DTP by using a computer 
or the like, the processing requires a large-capacity memory for storing the data and a high communication 
10 time cost for communicating the data. To reduce the memory capacity or the communication time cost, an inr>- 
age data compression technique is essential, and so a variety of compression methods have been proposed. 

As a general compression method for processing color multivalue images, an ADCT (Adaptive Discrete 
Cosine Transform) compression method according to a JPEG (Joint Photographic Expert Group) is usable. 
The ADCT compression method is a compression method for compressing primarily natural images, and a high 
15 compression ratio can be expected in this method although the method is an irreversible compression method. 

The ADCT compression method performs compression as follows. First, a 3-primary-color (RGB) signal 
is converted into three components of Y, U, and V: Y indicates a luminance component, and U and V indicate 
chromaticity components. By making use of the fact that the visual sense of man is more sensitive to a lumi- 
nance component than to a chromaticity component, the Y component is compressed without changing the 
20 resolution, whereas the U and V components are compressed while the resolution is lowered by subsampling. 

Subsequentiy, each component of the YUVdata obtained by the subsampling is subjected to DCTin units 
of blocks each having a size of 8 x 8 and extracted as a spatial frequency component. The component proc- 
essed by the DOT will be referred to as a "DCT coefficienr hereinafter. These DCT coefficients are linearly 
quantized (divided) by using quantization tables which are provided for each set of a luminance component 
25 (Y) and chromaticity components (U and V), and each of which has a size of 8 x 8. The resulting coefficients 
thus quantized will be referred to as ''quantized coefficients" hereinafter. Lastly, these quantized coefficients 
are coded by using Huffman coding which is a variable-length coding method. 

The foregoing is the compression procedure according to the ADCT compression method. 
Since, however, the Huffman coding used in the process of the above ADCT compression method is a 
30 variable-length coding method, the quantity of compressed data is unknown until coding is finished. It is, there- 
fore, impossible to control the quantity of data to a target compressed data quantity (i.e., impossible to con»- 
press whole image data into a predetermined fixed length). 

In addition, when this ADCT compression method is applied to characters and graphics formed by CG 
(Computer Graphics), many errors occur in the subsampling or the quantization, resulting in considerable deg- 
35 radation in the characters and the graphics. 

SUMMARY OF THE INVENTION 

The present invention has been made in view of the above problems and has as one object to provide an 
40 image processing method and an image processing apparatus capable of controlling the quantity of code data 
to a target data quantity. 

In one aspect the invention provides an image processing apparatus and an image processing method 
capable of monitoring an amount of code data received in sequence, and assigning stage information to the 
code data in accordance with the code amount monitored. 

45 In another aspectthe invention provides an image processing apparatus and an image processing method 

capable of performing reversible ccKling or irreversible coding adaptively in accordance with the characteristic 
feature of an image (e.g., whether an image is a character image or a halftone image) of input block image 
data, thereby compressing the image into an appropriate code quantity. 

Other features and advantages of the present invention will be apparent from the following description tak- 

50 en in conjunction with the accompanying drawings, in which like reference characters designate the same or 
similar parts throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

55 Fig. Us a schematic block diagram showing the arrangement of an imaae processing apparatus according 

to an embodiment of the present invention; 

Fig. 2 is a view showing the scan directton in a zigzag scan operation; 

Fig. 3 is a block diagram showing the arrangement of an adaptive Huffman coder according to the first 
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embodiment of the present invention; 

Fig. 4 is a view showing data stored in a buffer memory 15 of the first embodiment; 
Fig. 5 is a view showing a threshold value table; 

Fig. 6 is a view showing the arrangement of a compression memory divided into segments; 
5 Fig. 7 is a view showing the arrangement of a segnrtent information table; 

Fig. 8 is a flow chart for explaining compressed data storage processing; 

Fig. 9 is a block diagram showing the arrangement of an adaptive Huffman coder according to the second 
embodiment of the present invention; 

Fig. 10 Is a view showing data stored In a buffer memory 22 of the second embodiment; 
10 Fig. 11 is a block diagram showing the arrangement of an adaptive Huffman coder according to the thinJ 
embodiment of the present Invention; 
Fig. 12 is a view showing an index table; 

Fig. 1 3 is a block diagram showing the arrangement of an image compressing apparatus according to the 
fourth embodiment of the present invention; and 
15 Fig. 14 Is a block diagram showing the arrangement of an image expanding apparatus of the fourth env 
bodiment. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

20 Preferred embodiments of the present invention will be described In detail below with reference to the ac- 
companying drawings. 

<Overall Arrangement> 

25 Fig. 1 is a schematic block diagram showing the arrangement of an Image processing apparatus according 

to an embodiment. Referring to Fig. 1. a CPU 11 performs control of the whole apparatus and settings of several 
different tables. A ROM 1 2 stores these tables, and a RAM 1 3 serves as a work area for performing t he settings 
of the tables. 

Processing for compressing image data will be described below. 
30 First, a color converter 1 converts Input RGB image data into Y, U, and V components through 3x3 linear 

matrix conversion represented by Equation (1) below: 
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Subsequently, a subsampling unit 2 performs subsampling for the Y, U. and V signals from the color con- 
40 verter 1 by using the fact that the sensitivity characteristic of a human eye is nnore sensitive to a luminance 
component (V) than chromaticlty components (U and V). In this subsampling, U and V are compressed at one 
of the following three compression ratios: 

Y : U : V = 4 : 4 : 4 (no subsampling), Y : U : V = 4 : 2 : 2 (subsampling is performed for U and V). and Y : U : 
V = 4 : 1 : 1 (subsampling is performed for U and V). The subsampling unit 2 outputs the signals in units of 8 

45 X 8 blocks. The Individual signals are output In an order of Y1 . U1 , V1 . Y2, U2, V2 in the case of Y : U : V 

= 4 : 4 : 4, in an order of Y1 . Y2. U1 , VI . Y3, Y4. U2, V2 In the case of Y : U : V = 4 : 2 : 2. and In an order 

of Y1, Y2, Y3. Y4, U1. V1, Y5. Y6. Y7, Y8. U2, V2 in the case ofY:U:V = 4:1:1. 

A DOT unit 3 performs DOT for these output data In units of 8 x 8 blocks, outputting DOT coefficients. A 
quantizer 4 quantizes the DOT coefficients in units of 8 x 8 blocks by using a quantization table 8, thereby 

50 outputting quantized coefficients. The quantizer 4 also rearranges 64 two-dimensional quantized coefficients 
into one-dimensional quantized coefficients from lower-frequency components to higher-frequency compo- 
nents In accordance with scan in a zigzag order as shown In Fig. 2, and supplies the rearranged quantized 
coefficients to an adaptive Huffman coder 5. The adaptive Huffman coder 5 encodes the consequent one-di- 
mensional data in units of 64 quantized coefficients in accordance with the method shown in Fig. 3 (to be de- 

55 scribed in detail later), and outputs the coded data, the length ("code length" represented by the number of 
bits) of each coded data, and a number (to be referred to as a "stage number" hereinafter) representing a stage 
to which the corresponding coded data is assigned. In this embodiment, four stages are provided as an ex- 
ample. 
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On the basis of the "coded data", the "code length", and the "stage number", a segment controller 6 writes 
compressed data corresponding to a stage indicated by the "stage number" into a compression memory 7. 
This compression memory Is divided into segments (see Fig. 6), and each compressed data is written in a seg- 
ment corresponding to the stage of that data. The information separated in these segments are also written 

5 in a segment information table 10 (see Fig. 7) at the same time. The data written in the information table 10 
is used in data expansion. The segment controller 6 controls the segments for storing data assigned to the 
individual stages, making fixed-length compression possible. 

The reason why this "fixed-length compression" is possible will be briefly described below. 

As described above, the quantized coefficients subjected to the ADCT are arranged, in an order of DC 

10 component low-frequency AC components ^ high-frequency AC components. When "smaller stage num- 
bers" are assigned to coded data with lower frequency components and "larger stage numbers" are assigned 
to coded data with higher frequency components, outputting or storing a large quantity of codes assigned with 
"larger stage numbers" makes storage of information of original images with a higher precision possible. That 
is, outputting or storing coded data of "larger stage numbers" means compression" with a higher precision. 

15 Therefore, by selecting the number of stages in which data is to be compressed in accordance with the capacity 
of the buffer memory or the quantity of compressed data of an image to be processed, the total quantity of 
data assigned to the individual stages can be controlled to a target data quantity. For example, "compression 
is performed" (data is output or stored) in only the first and second stages, in only the first, second, and third 
stages, or in all of the first to fourth stages. Suppose, for example, that data quantities that can be "output" in 

20 the first second, third, and fourth stages are 2.5, 1.5, 0.8, and 0.5 MB, respectively, and a target data quantity 
is 5.0 MB. In this case, a total compressed data quantity of 4.8 MB can be obtained by the use of the first, 
second, and third stages, thereby controlling compression within the target data quantity. As described above, 
the way of assignment of all coded data to th^ individual stages has an effect on the precision of the fixed- 
length coding. The segment controller 6, the compression memory 7, and the segment information table 10 

25 will be described in more detail later. 

<1st Embodiment...Data Compression> 

The above adaptive Huffman coder 5 will be briefly described first with reference to Fig. 3, and then the 

30 details of the individual blocks will be described. 

When a "total target bit rate number" ("bit rate" is a unit indicating a compression ratio, which is the number 
of bits per pixel [bits/pixel]) as the target value of a whole image and a target bit rate number in the first stage 
are set, the Huffman coder 5 first performs coding in the first stage and then substantially equally divides the 
remaining target bit rate number (= "total target bit rate number" - "1st stage target bit rate number") in the block 

35 into three portions. Subsequently, the Huffman coder 5 outputs "coded data," "code length," and "stage num- 
ber" in each stage such that the equally divided bit rates are assigned to the second, third, and fourth stages. 
Assuming, for example, that the "total target bit rate number" is 2.4 bits/pixel and the "first stage target bit rate 
number" is 1 .5 bits/pixel for an image of an 8 x 8 block, the "target bit rate number" in each of the second, third, 
and fourth stages is 0.3. 

40 The details of the adaptive Huffman coder 5 are illustrated in Fig. 3. As shown in Fig. 3, the adaptive Huff- 

man coder 5 comprises a Huffman coder 14, a buffer memory 1 5, a reference value calculator 16, a code length 
accumulator 17, a comparator 18. and a stage determining unit 20. As described above, the coder 5 outputs 
coded data, code lengths, and stage numbers. The stage determining unit 20 determines a "stage number" to 
be assigned to each coded data coded by the coder 14. The code length accumulator 17. the comparator 18, 

45 and the reference value calculator 1 6 accumulate the values of the code lengths of coded data, compare the 
accumulated value with a predetermined threshold value, and generate, on the basis of the comparison, an 
"index number" obtained when the accumulated value exceeds the threshold value and also generate a sep- 
arately determined "reference value". The determining unit 20 determines a "stage" on the basis of the "index 
number" and the "reference value". Since the stage determination is time-consuming, the buffer memory 15 

50 is needed to output a "stage number" from the determining unit 20 in synchronism with "coded data" and its 
"code length" generated by the coder 14. The system shown in Fig. 3 will be described in more detail below. 

In Fig. 3. the Huffman coder 14 perfornns Huffman coding for one-dimensionally arranged quantized coef- 
ficients arranged one-dimensionally in units of 64 quantized coefficients (for each of the 8 x 8-block Y, U, and 
V components) and outputs coded data and code lengths to the buffer memory 15 and block terminating sig- 

55 nals each indicating the end of a block to the code length accumulator 17. The buffer memory 15 stores these 
data as shown in Fig. 4. 

The buffer memory 15 illustrated in Fig. 4 consists of an "INDEX" field, a "CODED DATA" field for storing 
Huffman codes, a "CODE LENGTH" field for storing the lengths of the codes, and a "CODE LENGTH ACCU- 
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MULATED VALUE" field for storing the accumulated values of the code lengths. The "INDEX" indicates the 
serial numbers of output coded data in one block. The code length accumulated values are obtained from the 
code length accumulator 17. 

In the arrangement shown in Fig. 4. values 0 to 18 are stored in the "INDEX" field for the first block, indi- 
5 eating that the block is coded into 19 Huffman codes. In addition, since the quantized coefficients supplied to 
the coder 14 are subjected to the DCT by the DCT unit 3, the first coded data has a DC component, and the 
subsequent coded data have AC components. Referring to Fig. 4. index 0 of the first block indicates a DC conv 
ponent, and indexes 1 to 18 indicate AC components. 

The code length accumulator 17 accumulates the code lengths of the coded data with AC components in 
10 units of blocks in synchronism with the block terminating signals and supplies the accumulated values to the 
comparator 1 8. The comparator 1 8 has a threshold value table 1 9 containing threshold values of the Y, U. and 
V components to be compared with these accumulated values. Fig. 5 shows a practical example of this thresh- 
old value table. In this example, threshold values "40". "28", and "28" are set for the Y, U. and V components, 
respectively. The comparator 18 outputs a reset signal to the accumulator 17; that is, the comparator 18 conv 
15 pares the accumulated value with the threshold value. If the accumulated value exceeds the threshold value, 
the comparator 18 does not accumulate the code length of coded data that causes the excess but supplies 
the index number (to be referred to as a "basic index number" hereinafter for convenience) of the immediately 
preceding coded data to the stage determining unit 20 and resets the code length accumulator 17. The accu- 
mulator 17 starts accumulating code lengths again from coded data next to the basic index number. Upon de- 
20 tecting the termination of the block in accordance with the block terminating signal, the accumulator 17 sends 
the obtained accumulated value at that time (i.e.. the accumulated value of code lengths obtained before the 
block is terminated after the resetting) to the reference value calculator 16. 

The reference value calculator 16 calculates a plurality of reference values from this final accumulated val- 
ue. These reference values are output to the determining unit 20. and the determining unit 20 determines sta- 
25 ges on the basis of the reference values and the basic index number from the comparator 18. 

The operation of the adaptive Huffman coder 5 according to the first embodiment will be described in more 
detail below with reference to Figs. 4 and 5. 

Fig. 5 shows examples of threshold values, 40, 28, and 28 [bits], for the Y, U, and V components, respec- 
tively, when the target bit rate in the first stage is set to be 1 .5 [bits/pixel]. Fig. 4 presents the coded data, the 
30 code lengths, and the code length accumulated values for a certain 8x8 block of the Y component As shown 
in Fig. 4, since index number 0 is a DC component the accunrvulator 17 does not accumulate the code length 
of this DC component but writes the code lengths from the code length (= 18) of the coded data of index = 1 
(AC component) into the field of accumulated values. The code length of the data with index number 2 is 7, 
so the accumulated value is 18 + 7 = 25. Similarly, the code length accumulated value for index number 3 
35 becomes 39. Since the code length of index number 4 is "21". the code length accumulated value becomes 
"60". However, this value "60" is compared with the threshold value (40 bits) of the Y component by the com- 
parator 18. yielding 60 > 40. Therefore, the immediately preceding index number "3" is supplied as the "basic 
index number" to the stage determining unit 20. The code length accumulator 17 is reset by the comparator 
1 8, and the code length "21 " of index number 4 is directly written as the code length accumulated value. The 
40 code length is "9" for index number 5, and so the code length accumulated value is 21 + 9 = 30. 

The code lengths of the subsequent coded data are accumulated in the same manner as described above, 
and the results are written in a field of code length accumulated values until the block is terminated. The final 
code length accumulated value "95" at index = 18 is transferred to the reference value calculator 16. The ref- 
erence value calculator 1 6 divides 95 by 3 because the number of remaining stages is 3 and supplies the quo- 
45 tient "30" together with "60" which is twice the quotient as "determination reference values" to the stage de- 
termining unit 20. 

On the basis of the index number (when the accumulated value exceeds the threshold value) obtained 
from the comparator 18 and the "determination reference values" obtained from the reference value calculator 
16. the stage determining unit 20 determines a "stage" value to be assigned to each coded data and code 

50 length data. The operation of the determining unit 20 will be described in more detail below. 

As described above, the data are stored in the buffer memory 15 as shown in Fig. 4. The buffer memory 
15 outputs "coded data", "code length" data, and "code length accumulated value" in synchronism with each 
other. Of these three data, the "code length accumulated value" is supplied to the determining unit 20. The 
determining unit 20 also receives the "basic index number" from the comparator 18. The determining unit 20. 

55 therefore, assigns stage = 1 to the coded data and the code lengths before the "basic index number". In the 
example of Fig. 4, since "basic index number" = 3. the coded data and the code length data corresponding to 
index numbers = 0 to 3 are processed as data of stage = 1 . The determining unit 20 determines and assigns 
stage numbers to the data of the index numbers after the "basic index number" on the basis of a plurality of 
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determination reference values described above. That is. the determining unit 20 has received "30" and "60" 
as the "determination reference values". The determining unit 20. therefore, compares the "code length ac- 
cumulated value" read outfrom the buffer memory with the "determination reference value" (= 30) and assigns 
stage number = 2 to the "coded data" and the "code length" data whose "code length accumulated value" is 

5 30 or less. The determining unit 20 assigns stage number = 3 when the "code length accumulated value" is 
31 to 60 and outputs stage number = 4 when it is 61 or more. In this case, at the end of each stage, an EOS 
(End of Stage) code indicating the end of the stage is inserted between the coded data. 

As described above, data can be compressed separately in a plurality of stages in units of blocks each 
having a size of 8 x 8 (= 64 coefficients). In the above operation, a bit rate of approximately 1.5 bits/pixel Is 

10 assigned to the data of the first stage, and the remaining data is compressed by equally dividing the bit rate 
into three portions. 

In the example shown in Figs. 4 and 5. the code length accumulated value of the Y component exceeds 
"40". In compression of image data of a block whose code length accumulated value does not exceed 40, an 
EOB (End of Block) data Is inserted in the middle of the data, and the coded data of the 8x8 block is entirely 
15 written in the segment for the first stage. 

The "coded data", the "code lengths", and the "stage numbers" thus obtained are supplied to the segment 
controller 6 (Fig. 1). and the "coded data" and the "code lengths" are stored in the compression memory 7 in 
units of segments in accordance with the "stage numbers". 

20 <1 St Embodiment...Data Expansion> 

A process of expanding the data that is compressed by the above-mentioned process will be described 
below. 

The system shown in Fig. 1 can perform both compression and expansion. That is, in performing expan- 

25 sion of data, the system of Fig. 1 operates as an expander simply by reversing the flow of data. In this case, 
the DOT unit 3, the quantizer 4, and the adaptive Huffman coder 5 serve asareverse DCT unit 3', a reverse 
quantizer 4\ and an adaptive Huffman decoders', respectively. The quantization table 8 and the Huffman table 
9 function as a reverse quantization table and a Huffman decoding table, respectively, reversing the flow of 
data to be opposite to that in the data compression. 

30 As described above, coded data constituting one 8x8 block are separated into a plurality of stages and 

stored in the compression memory 7. The adaptive Huffman decoders', therefore, first requests the segment 
controller 6 to send coded data of stage number = 1. The segment controller 6 reads out the coded data in the 
first stage from the compression memory 7 by referring to the contents of the segment information table 10 
and transfers the readout data to the adaptive Huffman decoder 5'. The adaptive Huffman decoder 5' sequen- 

35 tially decodes the coded data thus obtained and transfers the results to the reverse quantizer 4*. The adaptive 
Huffman decoder S' repeats this processing until it detects the EOS (End of Stage). 

Upon detecting the EOS, the decoder 5' requests the controller 6 to send coded data of the next stage 
number 2. The segment controller 6 reads out the coded data in the second stage from the compression menv 
ory 7 by making reference to the contents of the segment information table 10 and transfers the readout data 

40 to the adaptive Huffman decoder 5*. The adaptive Huffman decoder 5' repeatedly executes decoding until an 
EOB (End of Block) code is detected, as in the compression. The decoder 5' similarly performs decoding for 
data in the third and fourth stages, thereby finishing decoding of one 8x8 block. In this case, if an EOB is 
detected in the middle of the processing, the decoder 5* starts decoding of the next 8x8 block without re- 
questing coded data in the next stage. If data up to the final stage cannot be stored in the compression memory 

45 owing to the quantity of compressed data of an image or the capacity of the compression menrwry, the decoder 
5' performs expansion by using data to the stage at that time. 

The quantized coefficients obtained as described above are reversely quantized by the reverse quantizer 
4' by using a reverse quantization table 8' and supplied to the reverse DCT unit 3\ The reverse DCT unit 3' per- 
forms reverse DCT for the obtained DCT coefficients, yielding Y, U', and V data. The subsampling unit 2 exe- 

50 cutes enlargement in accordance with the subsampling ratio (Y :U:V = 4:4:4, 4:2:2, or4:1 :1). The 
color converter 1 performs reverse conversion in accordance with Equation (2) below, restoring th6 original 
image: 

55 
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<1st Embodiment...Segmentation> 

10 The processing of storing compressed data divided into multiple stages into the compression memory 7 

constituted by a plurality of segments and storing the segment information of a selected segment into the seg- 
ment information table 10. which is performed in image data compression and expansion, will be described in 
detail below. 

As shown in Fig. 6, the compression memory 7 consists of a plurality of segments (e.g.. one segment = 
15 100KB)S-1toS-N. 

Fig. 7 shows the arrangement of the segment information table 10. The values 2 to 11 in the segment in- 
formation table illustrated in Fig. 7 represent column numbers of the table, indicating the start to the end of 
an image in a direction from the left to the right Each of the fourdata in the first column of the table 10 indicates 
whether the corresponding stage is used (valid) or cancelled (invalid). In the table shown in Fig. 7, stages 1 
20 to 3 are valid (used), and stage 4 is invalid (cancelled). The four data in each of the second to the eleventh 
columns indicate the segment numbers (S-1 to S-N). selected in the compression memory 7. in which coded 
data at these stages are written. END indicates that coded data is ended in that stage. 

A procedure of writing coded data at eacb stage into the compression memory 7. i.e.. allocation of coded 
data in each stage to a segment will be described below. In this allocation: 
25 (1) CkKled data in the same stage for different pixels are stored in the same segment as long as an empty 

area is present. 

(2) If a segment for storing coded data in a certain stage is full, the first one of segments which are not 
used by other stages is used. 
Such an allocation makes effective use of the compression memory 7 free from wasted areas. This allocation 
30 will be described in detail below. 

Fig. 8 is a flow chart for explaining processing of storing compressed data in the above data compression. 
The quantities of codes of compressed data to be assigned to the individual stages change in accordance with 
a compression method for assigning the data to the stages or the characteristics of data of an original inr^ge. 
In this embodiment, however, assume that the quantity of codes output in stage 1 is larger than that output in 
35 stage 4. 

On the basis of the above assumption, the control procedure of the flow chart in Fig. 8 will be described 
below by using the example shown in Fig. 7. 

In step SI of Fig. 8. coded data output in stages 1 to 4 for image data of the first block are written in the 
segments S-1, S-2. S-3. and S-4, thereby starting the processing. Coded data generated in the individual sta- 

40 ges for the subsequent blocks will also be written in the segments S-1 . S-2, S-3. and S-4. This write operation 
is continued until it is detected in step S2 that any of the segments is full. According to a compression method 
of this type, compression at stage = 1 is always performed, and so coded data at stage = 1 are generated in 
a larger quantity than those at the other stages. It is, therefore, predicted that the segment S-1 for storing the 
coded data at stage = 1 becomes full before the segments S-2 to S-4. For this reason, if it is detected in step 

45 82 that the segment S-1 is full, writing of the coded data at stage = 1 into the segment S-5, which is the first 
one of unused segments, is started in step S3. 

When an empty area of either the segment S-2 or S-3 for storing coded data at stage = 2 or 3 becomes 
ftjll, a new segment is allocated to the full stage. In the example shown in Fig. 7, the segment S-2 for stage 2 
becomes full before the segment S-3 for stage 3, and the segment for stage 2 is allocated to the area S-6. 

50 Subsequently, when the segment S-3 for storing the data at stage = 3 becomes full, an empty segment S-7 
is allocated. 

Since writing into the segment S-5 for writing the coded data at the stage 1 is finished before the segment 
S-4 for storing the coded data at stage = 4 becomes full, an empty segment S-8 is allocated not to stage = 4 
but to stage = 1. This occurs because the quantity of codes generated in stage 1 is larger than that in stage 
55 4. In the same manner as described above, when a segment for writing coded data at a given stage becomes 
full, an empty segment is selected to write the data in it (steps S2 to S4). 

The embodiment employs the method of coding an original image divisionally in several stages. For this 
reason, if the quantity of data to be coded in each stage is smaller than the capacity of the compression mem- 
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ory 7, i.e., if compression of the whole image is finished before the segment S-N is allocated, no problem of 
memory capacity arises. If, however, the lastsegnr^nt S-N is allocated before compression of the entire image 
is finished (YES in step S4), a segment used for coded data with a larger number (stage = 4 in Fig. 7) must 
be freed for more significant coded data. i.e.. coded data with a smaller number (stage = 1 in Fig. 7). Step S5 

5 in Fig. 8 is provided for this freeing procedure. 

That is. in the example shown in Fig. 7. as the last segment S-N is used to store the coded data at stage 
= 2. there is no empty area in the compression memory 7 at that point Therefore, segments (S-4, S-11, and 
S-15 in Fig. 7) for storing the coded data at stage = 4 of less significance are freed to be used as areas for 
storing the coded data at stage = 1 or stage = 2. In the example shown in Fig. 7, the coded data at stage = 1. 

10 stage = 2, and stage = 1 are stored in the segments S-4. S-11 . and S-1 6. respectively. Since only invalid data 
are stored in the fourth row indicating stage = 4 in the segment information table 10. the corresponding bit in 
the first column is set to 0. In this manner, if the capacity of the compression memory 7 becomes insufficient, 
stage 4 of less significance is rendered invalid (e.g.. set to "0") so that the segments S-4 and S-11, that have 
been used for stage 4. are used for stage = 1 and stage = 2. respectively. Since coding for stage = 2 ends in 

15 the segment S-11. END marks are written in the subsequent columns. Since the segment S-1 5 which has been 
used for stage = 4 is allocated to stage = 1 and coding ends in that segment, an END mark is written in the 
next column. 

In expanding the compressed data stored in the compression memory 7, the image data is decoded by 
using valid stages 1 to 3 alone. 



20 



<2nd Embodiment> 



The arrangement and the operation of an adaptive Huffman coder 5 based on indexes according to the 
second embodiment of the present invention will be described below with reference to the block diagram shown 
25 in Fig. 9. 

In the first embodiment described above, stage number is determined by accumulating code lengths and 
checking whether the accumulated value of code lengths reaches a predetermined value. In the second em- 
bodiment, although determination of stage = 1 is performed in the same manner as in the first embodiment, 
determination of stages from stage = 2 is performed on the basis of index numbers. 

30 Referring to Fig. 9. a Huffman coder 21 performs Huffman coding for one-dimenslonally arranged quan- 

tized coefficients in units of 64 quantized coefficients (i.e.. for each of 8 x 8-block Y. U. and V components) 
and outputs coded data and code lengths to a buffer menwry 22. The Huffman coder 21 also outputs code 
length data and block terminating signals each indicating the end of a block to a code length accumulator 25. 
The buffer memory 22 stores the coded data and the code length data in the form as shown in Fig. 10. Re- 

35 ferring to Fig. 1 0, "INDEX" is the same as the "INDEX* number in the first embodiment and indicates the serial 
numbers of coded data output in one block. The number of significant bits of the coded data is designated by 
"CODE LENGTH" as in the f irst embodiment. 

The code length accumulator 25 accumulates the code lengths of coded data (of only an AC component) 
in units of blocks in synchronism with the block terminating signals and outputs the accumulated value to a 

40 comparator 26. The comparator 26 compares the accumulated value with threshold values prepared for Y, U, 
and V. These threshold values are supplied from a threshold value table 27 having essentially the same ar- 
rangement as that in the first embodiment If the comparator 26 determines that the accumulated value ex- 
ceeds the threshold value, the comparator 26 outputs an index immediately before the excess as a "basic in- 
dex" to a counter 23 and a stage determining unit 24. Therefore, the "basic index" in the second embodiment 

45 has the same meaning as the "basic index" in the first embodiment 

When the threshold value table 27 has the threshold values as shown In Fig. 5 and the coded data are 
like those Slustrated in Fig. 10, the accumulated value exceeds the threshold value (= 40) at index = 4. and 
the "basic index" becomes "3". In the seconds embodiment, coded data of indexes before the "basic index" 
number, i.e.. coded data of indexes 0 to 3 in Fig. 10 are regarded as data at stage = 1 and written in a com- 

50 pression memory 7 as data at stage = 1 . 

The counter 23 counts all of the input coded data of one block; the counter 23 counts indexes from the 
first AC component of one block. Upon detecting from the block terminating signal that one block is terminated, 
the counter 23 calculates a plurality of "reference indexes" from the last index number (to be referred to as a 
"last index" hereinafter) and the "basic index" obtained from the comparator 26 and supplies them to the stage 

55 determining unit 24. 

In the example shown in Fig. 10, since the "basic index" number is "3" and the last index """i^er 's 

it is determined that data to which stages = 2, 3 are to be allocated are those firom indexes "4" to "18". 

Therefore, all the coded data of indexes 4 to 18 are equally divided into three groups, and stages - 2, 3 
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are allocated to the individual divided coded data groups. More specifically, the number of codes in each group 
is *5" because (18 - 3)/3 = 5. and "8" (=3 + 5) and "13" (=8 + 5) are output as the "reference indexes". The 
block terminating signal from the Huffman coder 21 also resets the code length accumulator 25 and the com- 
parator 26. 

5 The stage determining unit 24 counts the indexes from the code length signals from the buffer memory 

22 and can thereby monitor the index numbers of coded data being output from the buffer memory. The de- 
termining unit 24 also receives the "reference index" numbers (8 and 13 in Fig. 10) from the counter 23 and 
the "basic index" number (3 in Fig. 10) from the comparator 26. In the example shown in Fig. 10, since the 
basic index is 3 and the reference indexes are 8 and 13, the determining unit 24 outputs stage number = 1 for 

10 data up to index 3 shown in Fig. 10, stage number = 2 for data corresponding to indexes 4 to 8, and stage 
number = 3 for data corresponding to indexes 9 to 1 3. Thereafter, the determining unit 24 outputs stage number 
= 4 until the block is terminated. During the processing, an EOS (End of Stage) code is inserted at the end of 
one stage number. This code is required in date expansion. 

An adaptive Huffman decoder for expanding the coded date obtained by the above coding method can 

15 be realized in the same fashion as in the first embodiment. 

<3rd Embodiment> 

The arrangement and the operation of an adaptive Huffman coder 5 based on indexes according to the 
20 third embodiment of the present invention will be described below. Also in this third embodiment, the number 
of input coded data is monitored. 

First, a Huffman coder31 performs Huffman coding forone-dimensionally arranged quantized coefficients 
in units of 64 quantized coefficients (i.e., for each of 8 x 8-block Y, U, and V components) and outputs coded 
data and code lengths. 

25 Suljsequently, a counter 32 counts the code length signals, detecting the number of input coded date, i.e.. 

the index number. The counter 32 transfers the count result, i.e., the index to a comparator 33. The comparator 
33 compares the index with values in an index table 35 as illustrated in Fig. 12. The index table in Fig. 1 2 stores 
the numbers of coded date to be allocated to the individual stages as index numbers. That is, in Fig. 12, index 
numbers 1 to 3, 4 to 8, 9 to 1 5, and 1 5 or more are allocated to stages = 1 , 2, 3, and 4, respectively, for the Y 

30 component. The comparator 33 compares these values in the index table in sequence with the outpute from 
the counter 32. The comparator 33 sends a countup signal to a counter 34 whenever the output value from 
the counter 32 exceeds the value in the table. The output from the counter 34 indicates a stage number and 
is initially set at 1. Upon receiving the countup signal, the counter 34 increments ite output value; that is, the 
stage number is incremented by one. 

35 To expand the data coded in accordance with the compression method of this third embodiment by using 

the compressor/expander shown in Fig. 1, an adaptive Huffman decoder 5* requeste a segment controller 6 
to send coded data of the stage number 1. The segment controller 6 reads out the coded date at the first stage 
(number = 1) from a compression memory 7 by referring to the contents of a segment information table 10 
and transfers the readout data to the adaptive Huffman decoders'. The adaptive Huffman decoder 5' decodes 

40 the coded data transferred and outpute the stage number to be requested next by making reference to the 
index table 35. The request for stage numbers and the decoding of obtained coded data are repeatedly per- 
formed in the same mariner as described above until the number of decoded quantized coefficients becomes 
64 (the number of elements in an 8 x 8 block). When 64 quantized coefficients are decoded, decoding for the 
next 8x8 block is started. 

45 In the first embodiment (Fig. 3) or the second embodiment (Fig. 9) described above, the bit rate is divi- 

sionally assigned to the individual stages on the basis of code lengthis. Compared to the first and second env 
bodimente. the use of the method (Fig. 11) of this third embodiment can reduce the dimensions of hardware 
because of its simple algorithm, thereby realizing the system at low cost, although the precision of the system 
is lowered. In addition, since no EOS code need be inserted at the end of each stage in one 8x8 block, the 

50 quantity of coded data is reduced accordingly. 

<Modificatbns of 1st to 3rd Embodiments> 

The above embodimente have been described assuming that the number of stages to which compressed 
55 data are assigned is four, but the number of stages may take any value, such as two or three, or five or six. 
In addition, although the target bit rate of a whole image is 2.4 [bits/pixel] in the above embodiments, the 
target bit rate may take any given value. 

Furthermore, the target bit rate in the first stage is 1.5 [bits/pbcel] and the value of the threshold value 
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table shown in Fig. 5 is determined according to this bit rate in the above embodiments. However, the taiget 
bit rate in the first stage need not be 1.5 [bits/pixel] as in the above embodiments but may be any arbittary 
v^riugh the c<ijed data from the second and subsequent stages are substantially equa^^y dmded mto 
three groups, the ratio of the second, third, and fourth stages can take any value, e.g.. 3 : 2 : 1 or 5 : 3 : 1 . 

Note thai the table shown in Fig. 9 is used as the index table as the reference of stage assignment m the 
third embodiment, but the values are not limited to those shown in Fig. 9. 



<4th Embodiment> 

The fourth embodiment of the present invention will be described in detail below with reference to the ac- 

"■"KSoirtrembodiment. characters and graphics contained in color images are compressed in accor- 
dance with a reversible compression method, whereas natural images are compressed in accordance with the 
ir^verSble compression method according to any of the above first to third embodiments, and the resultant 
compressed data are stored separately into a pluralfty of stages. „,„h »^ 

Fig 13 is a schematic block diagram showing the arrangement of an image compressing aPParat"S ac- 
cording to the fourth embodiment Referring to Fig. 13. a raster-tcvblock t\°TLTinn un"! 42 
bits per pixel which are supplied in raster sequence, in units of blocks (8 x 8 pixels). A block delaying unit 42 
tem^rarily s ores image data of one block, thereby delaying the image data. An irreversible, compr^sor « 
compresses the image data in accordance with the irreversible compression method; the '^"^^'^'^''l^ 
presses the block sequemial data from the block delaying unit 42 and outputs the compressed coded data di- 
LonallyinaplurBlityofstages.Asegment controller 44 can storethe coded data divided intom^^^^^ 

into a flit storage unit 45. which Is constituted by a plurality of segments, in accordance w. h tl^e steges to 
which the coded data are assigned, as in the above embodiments. This storing means can realize f*e|l-leng h 
compression, and segment numbers selected for the individual stages are stored in a segment information table 

A reversible compressor 47 reversibly compresses the block sequentially supplied image date in unite of 
blocks. The reversible compressor 47 stores the result of compressfon in a ^^'^^^''^^'^''^^J^rl^ 
and also counts the quantity of the compressed data. Assuming that the count result is D and the 1 mit value 
permitted forthat block is U ^L^ D. the block is labeled region 0; if L< D. the btock is '^^eled region 1^ The 
result ("determination signal") is stored in a second storage unit 49. The second storage unit 49^herefore. 
serves as a block map in which each block is represented by one bit for indicating whether the block is region 
0 or region 1 . That is. it is determined that the code quantity D exceeds the limit value L in a block found to 

^ 'h'tTe^oompresston system of this fourth embodiment, codes obtained by the reversible coding method 
are adopted for a block (region 0) in which the quantity of compressed codes obtained by the revei^ible ogling 
method does not exceed the limit value L. and the irreversible coding is performed for a block (region 1) in 
which the compressed, code quantity exceeds L 

Tn Hg 13 since the irreversible compressor 43 codes data delayed by one block, both reve^iWy com- 
pressed Lied data and irreversibly compressed coded data of image data of one block are supplied in syn- 
chronism with each other to the segment controller 44. In addition, the '^^'^^^^^'^^'^'tl'T^^^^^ 
determination signal described above to the compressed data holding unit 48 and the irreversible compressor 
JfThat is. the reversible compressor47transfe,s the compressed data ofablockfoundto^^ 

is stored in the compressed data holding unit 48. to the segment controller 44 f " °'»'«;']f "^ImZ 
pressed date of a block found to be region 1 . which is stored in the compresseddate holding unit 48. 'S rendered 
invalid by the reversible compressor 47. To compress that block by the irreversible compression -nethod he 
reversible compressor 47 transfers a signal instructing this processing to the irreversible compressor43. caus- 
ing the irreveisible compressor 43 to compress the block. The arrangement and the operation of the irreve - 
Lible compressor 43 are the same as those in the above embodiments and a deteiled descnption thereof will 

^ °Core?der a case in which color images conteining characters, graphics, natural images and the like formed 
by color DTP are supplied to the system shown in Fig. 13. in this case. CG images, such as characters and 
graphics that are compressed using a reversible compression method, have a high compression eff-c^ncy to 
yield D < U so it is preferable to compress them by the reversible compression method with good restonng 
properties. Since, on the other hand, natural images have a large variation in pixel values, the date q"anhty 
cannot be expected to be reduced by the reversible compression. The natural images, therefore, are desirably 
compressed by the irreversible compression method with a high compression efficiency. 

According to the process of the fourth embodiment, of color images containing characters, graphics, natu- 
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ral images, and the like formed by color DTP. CG images, such as characters and graphics, can be compressed 
by the reversible compression method, and natural images can be compressed by the irreversible compression 
method. 

A process of expanding the compressed data will be described below with reference to Fig. 14. 
5 Fig. 14 is a schematic block diagram showing the arrangen^nt of an image expanding apparatus according 

to the fourth embodiment in which the same reference numerals as In Fig. 13 denote the same parts. This 
expanding apparatus performs expansion by using the system shown in Fig. 1 3 on the basis of the data stored 
in the first storage unit 45 and the second storage unit 49. 

In accordance with coded data and code length requested by an irreversible expander 51 or a reversible 
10 expander 52. the segment controller 44 generates an address of the first storage unit 45 divided into a plurality 
of segments by referring to the segment information table 46 and transfers the coded data to the irreversible 
expander 51 or the reversible expander 52. 

The irreversible expander 51 is for expanding data compressed by the irreversible compressor 43 shown 
in Fig. 13 and generates the code lengths and the stage numbers of coded data that the expander 51 itself 
75 requests. The irreversible expander 51 expands the coded data generated and transfers the expanded data 
to a switching unit 53 in units of blocks. 

The reversible expander 52 is for expanding data compressed by the reversible compressor 47 shown in 
Fig. 13 and generates the code lengths and the stage numbers of coded data that the expander 52 itself re- 
quests. The reversible expander 52 expands the coded data generated and transfers the expanded data to 
20 the switching unit 53 in units of blocks. 

The switching unit 53 selectively outputs the input data on the basis of bit information stored in the second 
storage unit 49. For example, the switching unit 53 selects the data from the reversible expander 52^when the 
bit information is "0". and the data from the irreversible expander 51 when the bit information is "1". A block- 
to-raster converter 54 raster-sequentially converts the output block sequential data from the switching unit 53, 
25 thereby ending the expansion process. 

According to this fourth embodiment, degradation in characters and graphics formed by CG can be pre- 
vented by the combination of the reversible compression method and the irreversible compression method. 
In addition, the reversible compression method limits compressed data by using a limit value, and the irrever- 
sible compression method divides output compressed data into multiple stages and stores them in the memory 
30 separated into a plurality of segments, making control of the quantity of the compressed data possible. 

<Modifications of 4th Embodiment> 

The reversible compressor 47 described above can be modified as long as it comprises means for counting 
35 compressed data in accordance with a reversible compression method, means for setting a limit value L. and 
means for comparing a count result D with the limit value L and outputting the comparison result. 

In the above fourth embodiment, in storing the compressed data, which are divided into multiple stages, 
into the compression memory 7 separated into a plurality of segments, these compressed data are rendered 
invalid in decreasing order of stage number from the one having the largest stage number (stage 4) to the one 
40 having the smallest stage number (stage 1). The present invention, however, is not limited to the above em- 
bodiment, and the compressed data can be adaptively. selectively rendered invalid. 

In addition, the segment information table is not limited to that illustrated in Fig. 11 but can be modified 
without departing from the scope of the present invention. 

The present invention is applicable to both a system constituted by a plurality of devices and an apparatus 
45 consisting of one device. 

Although the operation of each of the above embodiments is realized by hardware logic, the present in- 
vention can be. of course, applied to a system in which its operation is achieved by programs. 

As many apparently widely different embodiments of the present invention can be made without departing 
from the spirit and scope thereof, it is to be understood that the invention is not limited to the specific embodi- 
50 ments thereof except as defined in the appended daims. 



Claims 



55 1, An image processing apparahjs for coding frequency coefficients in units of blocks, and outputting code 
data divisionally in a plurality of stages, comprising: 

coding means for coding the frequency coefficients in units of blocks; 

monitoring means for rrionitoring an amount of code data which has coded by said coding means; 



11 



EP0 586 074 A2 



allocating means for allocating stage Information to the code data from said coding means on the 
basis of the amount of code data monitored by said monitoring means; and 

output means for outputting the code data from said coding means in accordance with the stage 
information. 

2. The apparatus according to daim 1 . wherein said monitoring means comprises: 

storing means for storing a number of codes for each stage, which is allocated beforehand as a 
threshold value to that stage; 

comparing means for receiving from said monitoring means a number of total code data output from 
said coding means as total code quantity and comparing the number of code data with a threshold value 
read out from said storing means; and 

determining means for determining a stage information for the code data from said coding means 
in accordance with the comparison result of said comparing means. 

3. The apparatus according to claim 1 , wherein said monitoring means comprises: 

storing means for storing a code quantity for each stage, which is allocated beforehand as a thresh- 
old value to that stage; 

comparing means for comparing a total code quantity from said monitoring means with a threshold 
value read out from said storing means; and 

determining means for determining a stage information for the code data from said coding means 
In accordance with the comparison result from said comparing means. 

4. The apparatus according to daim 1 , wherein said output means comprises: 

data storing means, divided into segments each having a predetermined unit size, for storing a plur- 
ality of code data; 

checking means for checking a free capacity of each segment; and 

table means for storing a correspondence between each segment of said data storing means and 
a stage to which code data stored in that segment belongs. 

5. The apparatus according to daim 4. wherein said output means comprises means for, when said checking 
means determines that no area for storing new code data belonging to a stage allocated to a given seg- 
ment is present in the searched segment, searching for an unused segment in said data storing means, 
storing the new code data in that unused segment, and updating the data in said table means. 

6. The apparatus according to daim 4, wherein said output means allocates a segnnent dosest to the seg- 
ment being currently used in searching for an unused segment. 

7. The apparatus according to daim 4, wherein when no empty area is present in said data storing means, 
said output means frees segments storing coded data belonging to subsequent stages. 

8. The apparatus according to daim 1 . wherein said output means outputs a pair of one code data and stage 
information allocated to that code data by said allocating means. 

9. The apparatus according to daim 1. wherein the frequency components of the image are extracted by 
orthogonal transformation and coded using Huffman codes. 

10. The apparatus according to claim 1 . wherein the frequency components of the Image are Input by a known 
frequency sequence and coded by said coding means. 

11. The apparatus according to daim 10, wherein the frequency components of the image are arranged in 
an order from lower-frequency components to higher-frequency components. 

12. An image processing method of coding frequency coefficients in units of blocks, and outputting code data 
divisionally in a plurality of stages, comprising the steps of: 

coding frequency coefficients in units of blocks; 

monitoring an amount of code data which has been obtained in the coding step; 
allocating stage information to the code data on the basis of the amount of code obtained by the 
monitoring; and 

outputting the code data in accordance with the stage information. 
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13. The method according to daim 12, wherein the monitoring step comprises the substeps of: 

storing a number of codes for each stage, which is allocated beforehand as a threshold value to 
that stage; 

monitoring a number of the input codes as total code quantity and comparing the total code quantity 
5 with a readout threshold value; and 

determining a stage information in accordance with the comparison result. 

14. The method according to daim 12, wherein the monitoring step comprises the substeps of: 

storing a code quantity for each stage, which is allocated beforehand as a threshold value to that 

fo stage; 

comparing a total code quantity with a readout threshold value; and 
determining a stage information in accordance with the comparison result. 



15 
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15. The method according to daim 12, wherein the output step comprises the substeps of: 
checking free capacities of individual segments of data storing means divided into the segments 

each having a predetermined unit size; and 

when it is determined that no area for storing new coded data belonging to a stage allocated to a 
given segment is present in that segment, searching for an unused segment in said data storing means, 
storing the new coded data in the searched unused segment, and updating the data in a table for storing 
a correspondence between each segment of said data storing means and a stage to which coded data 
stored in that segment belongs. 

16. The method according to daim 15, wherein the output step allocates a segment dosest to the segment 
being currently used in searching for an unused segment. 

17. The method according to daim 15, wherein when no empty area is present in said data storing means, 
the output step frees segments storing coded data belonging to subsequent stages. 

18. The method according to daim 12, wherein the output step outputs a pair of one coded data and stage 
information allocated to that coded data. 

30 

19. The method according to daim 12, wherein the frequency components of the image are exfracted by or- 
thogonal transformation and coded using Huffman codes. 

20. An image processing method of quantizing an image in a frequency space, coding the quantized frequency 
35 coefficients in units of blocks, and outputting the coded data divisionally in a plurality of stages, comprising 

the steps of: 

coding a quantized frequency coefficients in units of blocks; 
accumulating code lengths of the coded data obtained in the coding step; 
determining a stage on the basis of an accumulation result obtained in the accumulating step; and 
4Q outputting the coded data in accordance with the determination result obtained in the stage de- 

termining step. 

21. An image processing apparatus for compressing image data input in block sequence by using different 
compression methods, comprising: 

first compressing means for compressing input block sequential image data by a reversil)le com- 
pression method; 

second compressing means for compressing the block sequential image data by an irreversible 
compression method in accordance with the compression result from said first compressing means, and 
outputting the compressed data divisionally in a plurality of stages; 

determining means for determining the characteristic feature of a block on the basis of the com- 
pressed data obtained by said first compressing means; 

selecting means for selecting one of the compressed data obtained by said first and second conv 
pressing means on the basis of the characteristic feature obtained by said determining means; and 
output means for outputting the selected compressed data divisionally in a plurality of stages. 



45 



50 



55 



22. The apparatus according to daim 21. wherein said determining means determines characters, graphics, 
or natural images. 
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23. The apparatus according to claim 22, wherein characters, graphics, or natural images are compressed 
and output by isaid first compressing means, natural images are compressed by said second compressing 
means, and the compressed data are divisionally output in a plurality of stages. 

24. An image processing apparatus for quantizing an image in a frequency space, coding the quantized fre- 
quency coefficients in units of blocks, and outputting the coded data divisionally in a plurality of stages, 
comprising: 

coding means for coding the quantized frequency coefficients in units of blocks; 
counting means for counting the coded data obtained by said coding means; 
stage determining means for determining a stage on the basis of the count result from said counting 
means; and 

output means for outputting the coded data in accordance with the determination result from said 
stage determining means. 

25. A block based method of image coding wherein the set of coefficients for each block is divided into a num- 
ber of subsets, and these subsets are included selectively in the output data so as to remain within a pre- 
determined code size limit. 

26. A method of image compression wherein different compression methods are available for different image 
content types, wherein the image content type and compression method to be used are selected auto- 
matically on the basis of the results of applying one or other of the compression methods to the image 
part of interest. 



14 



EP0 586 074 A2 



CO ^ 
Q- UJ 

O 

o 



CO 

c/5 

LU 
CC 
Q 

o 



CD 



< 



CC 
O 



OS 



CO 
LU ^ 
O 

3 UJ 
OO 
O 





' co' 


CODE 
LENGTH 


TAGE 
MBER 


CO 3 




^ S 

tr l£ Q 

^ Li. o 



i 

UJ 

Go 

O 
o 



LU 
M 



o 





2 

^ UJ 




U. CD 



CO 



CVJ 







DCT 
UNIT 


>^ 

ZD 
>- 





CO 



S LU 

I— <i 
z I— 

<: 
z:> 
o 



iiNn 
ONHdmsans 



H3ia3ANO0 

aoloo 

m 



15 



EP0 586 074 A2 



FIG. 2 




16 



EP0 586 074 A2 



CO 



o 
o 

UJ 

o 

o 
o 



CD 



UJ 

o 
o 
o 



LU 

I 

CO 



CO 



o 

CO 



o 

S UJ CO 

CC CC LU 
UJ UJ ZD 



o 








UJ z 






bz 


STA 
ETER^ 


UN 


o 






17 



EP0 586 074 A2 



r 



LU 

< h- 

< CO 



I- ^ uj 

UJ 3 -> 

UJ o < 
cc < > 



o 
































^1 1 
































1— 


































<; Qj 








































00 


in 






o 


lO 








in 






^ — 




ii 








CVJ 


CO 


CM 


CO 




_ 






CD 






CM 






































O 
































o 
































































































O 2 


CO 


00 






cvi 


o 


in 








in 




CM 




O UJ 


































































<M 




O 


CO 


LU 


o 


O 








< 


CM 








LL 


< 


1^ 


CO 




< 


LU 










LU 


O 






LL 




o 


IT) 


in 




CM 








o 


1^ 


CM 




<: 

Q 




LL 


o 


CO 


O 


o 










o 


CO 


< 




Q 


O 


CO 


o 


o 




o 


o 








o 


o 


Li- 




LJU 


O 


O 


o 


o 




o 


o 








o 


o 


CO 




Q 
O 


O 


O 


o 


o 


o 


o 


o 








o 


o 


O 




O 


O 


O 


o 


o 


o 


o 


o 








o 


o 


O 








X 


X 


X 


X 


X 


X 


X 








X 


X 


X 






O 


o 


o 


o 


o 


o 


o 








o 


o 


O 




DEX 


< 








CO 




in 


CD 








CO 


o 







































































1^ — - 




— 't^ 






Y 












CO 


1- 


h- 


1— 


H" 










LU 


UJ 


LU 


LU 










o 


O 


o 


o 


CL 


0- 










:e 




o 


O 


o 


o 


o 


o 


o 


o 


o 


o 


o 


o 


o 


< 


o 


<: 



18 



EP0 586 074 A2 



FIG. 5 



COLOR COMPONENT 


THRESHOLD 
VALUE (BITS) 


Y COMPONENT 


40 


U COMPONENT 


28 


V COMPONENT 


28 



FIG. 6 

COMPRESSION MEMORY 



SEGMENT S-1 (lOOKB) 



SEGMENT S-2 (100KB) 



SEGMENT S-3 (100KB) 



SEGMENT S-4 (100KB) 



SEGMENT S-N (100KB) 



19 



EP0 586 074 A2 



UJ 

O 
< 

u_ 
O 
O 



A 



CO 



O 
< 
cc 

o 

u. 
I- 



UJ 
CO 



UJ 



cc 

CO 





END 


END 


END 




o 


in 

CO 


END 


END 






T 

CO 


S-11 


END 




00 


S-(N.1) 


S-N 


END 








1 


S-(N-2) 




CD 


s-14 


1 


* 


( 




S-10 


S-13 


1 


1 




S-8 


S-9 


S-12 


S-15 


CO 


S-5 


S-6 


S-7 


CO 


CM 


CO 


S-2 


S-3 


S-4 










o 


No. 


STAGE (1) 


STAGE (2) 


STAGE (3) 


STAGE (4) 



20 



EP0 586 074 A2 



FIG. 8 



c 



START 



I 



WRITE CODED DATaIn 1/ 
INDIVISUAL SEGMENTS. 
START PROCESSING 



S1 




START WRITING INTO 
EMPTY SEGMENT 



,S4 



^° ^5llocation'to segment; 
^s-n finished^ 



YES 



RE-ASSIGN CANCELLED STAGE / 
TO OTHER STAGE 



c 



I 

END 



S5 



21 



EP0 586 074 A2 




cr 






o 






ATI 






tr 






<c 


<] 


«^ LLI 


MP 




uj b!^ 


COI 


ED 





o ^ 

o 

< 



1^ 



T 



LU 



O 

o 



o 

O 

o 

CQ 



22 



EP0 586 074 A2 



FIG. 10 
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FIG. 12 
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